Information interaction method and apparatus, storage medium, and electronic apparatus

ABSTRACT

This application discloses an information interaction method and apparatus, a storage medium, and an electronic apparatus. The method includes obtaining a first target operation instruction in a VR scenario; selecting and displaying a first virtual operation panel corresponding to the first target operation instruction from a plurality of virtual operation panels in the VR scenario, wherein the plurality of virtual operation panels are displayed mutually independently, and are respectively configured to display different interactive objects. The method may further include obtaining an interactive operation instruction generated by an interactive operation performed by an interactive device on a target interactive object displayed in the first virtual operation panel, the interactive device being associated with the VR scenario; and in response executing a target event corresponding to the target interactive object in the VR scenario. These solutions resolve the technical problem of low information interaction flexibility in the related technology.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation of International Patent ApplicationNo. PCT/CN2018/106936, filed on Sep. 21, 2018, which claims priority toChinese Patent Application No. 201710873684.X, entitled “INFORMATIONINTERACTION METHOD AND APPARATUS, STORAGE MEDIUM, AND ELECTRONICAPPARATUS” filed with the China National Intellectual PropertyAdministration on Sep. 25, 2017, all of which are incorporated byreference in their entirety.

FIELD OF THE TECHNOLOGY

This application relates to the field of computers, and specifically, toan information interaction method and apparatus, a storage medium, andan electronic apparatus.

BACKGROUND OF THE DISCLOSURE

Currently, for games in a two-dimensional (2D) display environment, suchas a host game and a mobile phone game, a menu is usually created byusing a 2D panel that is faced to a display and that is independent of ascenario. In a case that the final display of a game is a 2D display,the menu is not content that needs to exist in a three-dimensional (3D)game scenario, but is used as a connection medium between a game playerand game content. The menu is created by using the 2D panel independentof the game scenario, so that the 2D panel may be directly faced to thedisplay direction of the display, for users to select more quickly andconveniently. Game logics of a virtual world are not affected, and thecreation of the menu is relatively independent. Therefore, the creationof the menu is not involved in all 3D game scenarios. In addition, onthe premise of mouse operation, directly clicking the menu of the gameby using a mouse is a very intuitive operation, and basically does notinvolve the possibility of a complicated interactive operation.

In a virtual reality (VR) environment, because a user may sense changesand feelings of a 3D space, the interactive operation manner may nolonger be the operation such as clicking the mouse, or no longer bereversely mapping to the 3D space according to a position change of a 2Dinterface to operate the virtual world, but directly obtaining aposition of the user in a real 3D space. The position may directlycorrespond to a 3D position of a virtual space. Therefore, no originalmouse operation (a correspondence from a 2D screen space to a 3D virtualspace) exists. The menu originally using the 2D panel is more suitablefor being displayed in a 3D manner, and the menu is used as a 3D objectof the virtual world and directly integrated into the virtual worldscenario, to more facilitate the operation of the user.

Interactions in the VR environment are implemented by interacting a rayemitted by an interactive device and a 2D menu panel of the 3D space.

FIG. 1 is a schematic diagram of an interface interaction in a VRenvironment according to the related technology. As shown in FIG. 1, theinterface is a menu interactive interface of Steam VR, and the Steam VRimplements VR experience of a fully functional 360° room space. In the3D space, a ray is emitted from a handle, the ray points to the 2D panelin the 3D space, and the intersection between the ray and the 2D panelis a position at which the user hopes to interact with the 2D panel. Theposition is similar to a position indicated by the mouse during themouse operation, and keys of the handle are similar to keys of themouse. The interactive operation and response are performed on the 2Dmenu panel in the 3D space by using the keys of the handle.

FIG. 2 is a schematic diagram of an interface interaction in another VRenvironment according to the related technology. As shown in FIG. 2, theinterface is a menu interactive interface of Oculus Home, and shares thesame operation process with a main menu interface of the Steam VR shownin FIG. 1. Oculus is an American VR technology company whose firstproduct Oculus Rift is a realistic VR head-mounted display.

The interface interactions shown in the foregoing FIG. 1 and FIG. 2 arecurrently common interaction solutions in which a 2D panel is convertedto a menu panel in a 3D plane mainly according to the mouse operation,and then a ray is directly used to perform an operation. Features ofsuch operation manner are as follows: First, the entire menu interfaceis a menu panel, and all menu content is simply concentrated on the menupanel, causing content of important menu systems to overlay on the menupanel, that is, the 3D virtual space is not fully used to displayinformation; second, the menu panel is relatively in a remote place inthe scenario and far from operators, and can only be contained in a veryempty scenario, instead of being suitable for any scenario in games;third, the menu panel is far from users, and cannot be touched veryintuitively but a ray operation manner needs to be used; finally, theposition of the menu panel is fixed in the scenario, causing a lack offlexibility for use of the menu panel, and menu options on the menupanel are difficulty to be used without pausing games, causing a problemof low information interaction flexibility.

Currently, there is no effective solution to the problem of lowinformation interaction flexibility in the foregoing related technology.

SUMMARY

Embodiments of this application provide an information interactionmethod and apparatus, a storage medium, and an electronic apparatus, toresolve at least the technical problem of low information interactionflexibility in the related technology.

According to an aspect of the embodiments of this application, aninformation interaction method is provided. The information interactionmethod includes: obtaining a first target operation instruction in a VRscenario; selecting and displaying a first virtual operation panelcorresponding to the first target operation instruction from a pluralityof virtual operation panels in the VR scenario, the plurality of virtualoperation panels being displayed mutually independently, and beingrespectively configured to display different interactive objects;obtaining an interactive operation instruction generated by aninteractive operation performed by an interactive device on a targetinteractive object in an interactive object displayed in the firstvirtual operation panel, the interactive device being associated withthe VR scenario; and executing a target event corresponding to thetarget interactive object in the VR scenario in response to theinteractive operation instruction.

According to another aspect of the embodiments of this application, aninformation interaction apparatus is further provided. The informationinteraction apparatus includes: a first obtaining unit, configured toobtain a first target operation instruction in a VR scenario; a displayunit, configured to select and display a first virtual operation panelcorresponding to the first target operation instruction from a pluralityof virtual operation panels in the VR scenario, the plurality of virtualoperation panels being displayed mutually independently, and beingrespectively configured to display different interactive objects; asecond obtaining unit, configured to obtain an interactive operationinstruction generated by an interactive operation performed by aninteractive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel, the interactivedevice being associated with the VR scenario; and a processing unit,configured to execute a target event corresponding to the targetinteractive object in the VR scenario in response to the interactiveoperation instruction.

In the embodiments of this application, a first target operationinstruction is obtained in a VR scenario; a first virtual operationpanel corresponding to the first target operation instruction isselected and displayed from a plurality of virtual operation panels inthe VR scenario, the plurality of virtual operation panels beingdisplayed mutually independently, and being respectively configured todisplay different interactive objects; an interactive operationinstruction generated by an interactive operation performed by aninteractive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel is obtained, theinteractive device being associated with the VR scenario; and a targetevent corresponding to the target interactive object is executed in theVR scenario in response to the interactive operation instruction. Aplurality of mutually independent virtual operation panels in the VRscenario is respectively configured to display different interactiveinformation, to implement different functions, thereby achieving theobjective of operating the virtual operation panel, improving operationflexibility of the virtual operation panel, and further resolving thetechnical problem of low flexibility information interaction in therelated technology.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings described herein are used for providingfurther understanding for this application and constitute a part of thisapplication. Exemplary embodiments of this application and descriptionsthereof are used for explaining this application and do not constitutean improper limitation to this application. In the figures:

FIG. 1 is a schematic diagram of an interface interaction in a VRenvironment according to the related technology.

FIG. 2 is a schematic diagram of an interface interaction in another VRenvironment according to the related technology.

FIG. 3 is a schematic diagram of a hardware environment of aninformation interaction method according to an embodiment of thisapplication.

FIG. 4 is a flowchart of an information interaction method according toan embodiment of this application.

FIG. 5 is a flowchart of a method for executing a target eventcorresponding to a target interactive object in a VR scenario accordingto an embodiment of this application.

FIG. 6 is a flowchart of a method for obtaining an interactive operationinstruction generated by an interactive operation performed by aninteractive device on a target interactive object in an interactiveobject displayed in a first virtual operation panel according to anembodiment of this application.

FIG. 7 is a flowchart of another method for executing a target eventcorresponding to a target interactive object in a VR scenario accordingto an embodiment of this application.

FIG. 8 is a flowchart of another information interaction methodaccording to an embodiment of this application.

FIG. 9 is a flowchart of another information interaction methodaccording to an embodiment of this application.

FIG. 10 is a flowchart of another information interaction methodaccording to an embodiment of this application.

FIG. 11 is a schematic diagram of an implementation structure of asingle panel according to an embodiment of this application.

FIG. 12 is a flowchart of another information interaction methodaccording to an embodiment of this application.

FIG. 13 is a schematic diagram of displaying a menu panel in a VRscenario according to an embodiment of this application.

FIG. 14 is a schematic diagram of interacting with a menu panel in a VRscenario according to an embodiment of this application.

FIG. 15 is a schematic diagram of interacting with a menu panel inanother VR scenario according to an embodiment of this application.

FIG. 16 is a schematic diagram of an information interaction apparatusaccording to an embodiment of this application.

FIG. 17 is a structural block diagram of an electronic apparatusaccording to an embodiment of this application.

DETAILED DESCRIPTION

To make a person skilled in the art better understand solutions of thisapplication, the following clearly and completely describes thetechnical solutions in the embodiments of this application withreference to the accompanying drawings in the embodiments of thisapplication. Apparently, the described embodiments are merely somerather than all of the embodiments of this application. All otherembodiments obtained by a person skilled in the art based on theembodiments of the present application without creative efforts shallfall within the protection scope of the present application.

In the specification, claims, and accompanying drawings of thisapplication, the terms “first”, “second”, and so on are intended todistinguish between similar objects rather than indicating a specificorder. It should be understood that data used in this way can beinterchanged in an appropriate case, so that the embodiments of thisapplication that are described herein can be implemented in a sequenceother than those sequences illustrated or described herein. In addition,the terms “include”, “comprise”, and any variants thereof are intendedto cover a non-exclusive inclusion. For example, a process, method,system, product, or device that includes a series of steps or elementsis not limited to the steps or units that are clearly listed, but mayinclude other steps or units that are not clearly listed or that areinherent to the process, method, product, or device.

According to the embodiments of this application, an embodiment of aninformation interaction method is provided.

Optionally, in this embodiment, the information interaction method maybe applied to a hardware environment formed by a server 302 and aninteractive device 304 shown in FIG. 3, or may be applied to a hardwareenvironment formed by only an interactive device 304. FIG. 3 is aschematic diagram of a hardware environment of an informationinteraction method according to an embodiment of this application. Asshown in FIG. 3, the server 302 is connected to the interactive device304 through a network. The network includes, but is not limited to, awide area network, a metropolitan area network, or a local area network.The interactive device 304 is not limited to a VR device or the like.All interactive devices supporting a 3D spatial position, for example, ahand-separated handle, may be supported. The information interactionmethod in this embodiment of this application may be performed by theserver 302, or may be performed by the interactive device 304, or may beperformed by both the server 302 and the interactive device 304. Whenthe interactive device 304 performs the information interaction methodin this embodiment of this application, the information interactionmethod may alternatively be performed by a client installed in theinteractive device 304.

FIG. 4 is a flowchart of an information interaction method according toan embodiment of this application. As shown in FIG. 4, the method mayinclude the following steps.

Step S402. Obtain a first target operation instruction in a VR scenario.

In the technical solution provided in the foregoing step S402 in thisembodiment of this application, the first target operation instructionis obtained in the VR scenario.

Virtual reality, that is, VR, uses a virtual technology, also referredto as a virtual environment, and is generating a virtual world of a 3Dspace through simulation by using a computer, and providing simulationabout sensory such as visions to a user, so that the user may feelimmersive, and may observe objects in the 3D space in timeunrestrictedly.

The VR scenario in this embodiment is a scenario suitable for a specificapplication obtained by simulating a real scenario by using theforegoing VR technology. For example, the VR scenario is a scenariosuitable for a game application obtained by matching a real spacecompletely to a virtual space by using the VR technology, where the gameapplication is a VR game application. In the VR scenario, a user matchesa virtual control role. Optionally, an operation of the user matches abehavior in a virtual scenario. For example, when the user presses a keyon an interactive device, selection on an interactive object displayedin a virtual operation panel is triggered. When the user releases thekey on the interactive device, the selection on the interactive objectdisplayed in the virtual operation panel is cancelled. In addition, theVR scenario may provide a simulation scenario about sensory such asvisions to the user, so that the user may observe objects in thescenario in time unrestrictedly by using a virtual role, and the usermay feel immersive in the real scenario.

The foregoing VR scenario is only an optional implementation in thisembodiment of this application, and it does not mean that therepresentation of the VR scenario in this embodiment of this applicationis only limited to the foregoing manner. Any representation form thatmay implement the information interaction method, and may improveoperation flexibility of the virtual operation panel falls within theprotection scope of this application, which is not described herein byusing examples.

The first target operation instruction is obtained in the VR scenario.The first target operation instruction may be an instruction used forselecting a to-be-operated virtual operation panel in the VR scenario.The virtual operation panel is a virtual interface used for displayingan interactive object in the VR scenario, for example, displaying amenu. Various game operations are integrated into the menu for use, anddifferent interactive functions in the VR scenario are implemented byselecting different menus. The user may generate the first targetoperation instruction by operating the interactive device, for example,moving a rocker on the interactive device, controlling a virtual objectin the VR scenario to move, pressing a button on a handle after theto-be-operated virtual operation panel is determined, and controllingthe virtual object to click the virtual operation panel, therebygenerating the first target operation instruction. The virtual object isused for instructing to operate an object in the VR scenario. Theinstruction may be performed by a virtual hand or another icon, which isnot limited herein.

Step S404. Select and display a first virtual operation panelcorresponding to the first target operation instruction from a pluralityof virtual operation panels in the VR scenario.

In the technical solution provided in the foregoing step S404 in thisembodiment of this application, the first virtual operation panelcorresponding to the first target operation instruction is selected anddisplayed from the plurality of virtual operation panels in the VRscenario. The plurality of virtual operation panels are displayedmutually independently, and are respectively configured to displaydifferent interactive objects.

In this embodiment, a plurality of virtual operation panels is disposedin the VR scenario, and the plurality of virtual operation panels areindependently displayed, and may display different content. For example,the virtual operation panel is a virtual operation panel configured toperform disposing, a virtual operation panel configured to displaypersonal information, a virtual operation panel configured to performinformation notification, a virtual operation panel configured totransmit and receive emails, a virtual operation panel configured tocommunicate with and manage friends, or the like, which is not limitedherein. The size of the plurality of virtual operation panels may bedetermined by displayed content. For example, when the virtual operationpanel needs to display more content, the size of the virtual operationpanel is larger, and when the virtual operation panel needs to displayless content, the size of the virtual operation panel is smaller.

Optionally, the virtual operation panel is implemented in the VRscenario in a 2D form, and may be completely compatible with the currentgame making manner. As long as a 2D menu interface is made, and then the2D menu interface is attached to an entity mesh model on the virtualoperation panel by using a component, for example, the 2D menu isattached to the entity mesh model on the virtual operation panel byusing a WidgetComponent, the virtual operation panel may be displayed ina game, and an interaction between the interactive device and thevirtual operation panel may be implemented.

Optionally, visual representation forms of the plurality of virtualoperation panels may vary, which are not limited herein. Interactivefunctions of the plurality of virtual operation panels may be different,or may have an association relationship, which is not limited herein,thereby fully using the advantage of spatial expansion brought by the VRenvironment, and preventing the entire menu interface from beingimplemented by only simply using one panel. All content is concentratedon one panel, causing a defect that important menu content overlays onthe panel.

Optionally, when the user actively opens the interface in the VRscenario, a plurality of virtual operation panels is displayed, and theplurality of virtual operation panels may be randomly placed in the VRscenario. The quantity and types of the plurality of virtual operationpanels may be preset. For example, three virtual operation panels aredisplayed, and the three virtual operation panels are respectivelyconfigured to play information, select expressions, and set volume,which are not limited herein.

After the first target operation instruction is obtained, the firstvirtual operation panel corresponding to the first target operationinstruction is selected and displayed from the plurality of virtualoperation panels in the VR scenario. After the first target operationinstruction is generated by using the interactive device, the firstvirtual operation panel corresponding to the first target operationinstruction may be selected and displayed from the plurality of virtualoperation panels in response to the first target operation instruction.Optionally, when the virtual object is controlled by using theinteractive device to touch the virtual operation panel, it isdetermined that the first virtual operation panel in the plurality ofvirtual operation panels is selected, or when the virtual object iscontrolled by using the interactive device to touch a preset selectedbutton on the virtual operation panel, it is determined that the firstvirtual operation panel in the plurality of virtual operation panels isselected, and the first virtual operation panel is displayed to displaycontent of the first virtual operation panel.

Optionally, a plurality of virtual operation devices corresponds toindication information used for indicating the plurality of virtualoperation panels, and the indication information of the plurality ofvirtual operation panels may be displayed in a form of a list or a menu,which is not limited herein. When the user controls, by using theinteractive device, the virtual object to click indication informationof a virtual operation panel, a first target operation instruction isgenerated, and the clicked virtual operation panel is further determinedas a first virtual operation panel.

Step S406. Obtain an interactive operation instruction generated by aninteractive operation performed by an interactive device on a targetinteractive object in an interactive object displayed in the firstvirtual operation panel.

In the technical solution provided in the foregoing step S406 in thisembodiment of this application, the interactive operation instructiongenerated on the interactive operation performed by the interactivedevice on the target interactive object in the interactive objectdisplayed in the first virtual operation panel is obtained, theinteractive device being associated with the VR scenario.

The interactive device in this embodiment is configured to generate aninteractive operation instruction in the VR scenario, and configured toperform an interaction between the user and the VR scenario, to obtain aposition of a 3D space. The interactive device may be a handleconfigured to capture actions, and may be configured to cooperate with aspace location system to use. A camera is allowed to track the hand ofthe user, and a sensor may also track finger actions, and also bring aconvenient grasp manner to the user. For example, the interactive deviceis a Vive device or an Oculus Touch device. The handle may be ahand-separated handle, configured to obtain position information in theVR scenario.

An interactive object is displayed in the first virtual operation panel.The interactive object may be used for indicating a function that may beimplemented by the first virtual operation panel, for example, anexpression selection function. The first virtual operation panel maydisplay a plurality of interactive objects. The plurality of interactiveobjects includes a target interactive object that the user expects toselect. The target interactive object may be used for implementing afunction that the user expects to implement in the VR scenario.

After selecting and displaying the first virtual operation panelcorresponding to the first target operation instruction from theplurality of virtual operation panels in the VR scenario, theinteractive device determines a target interactive object in theinteractive object displayed in the first virtual operation panel, andobtains the interactive operation instruction generated by theinteractive operation performed by the interactive device on the targetinteractive object, for example, obtains an interactive operationinstruction of closing the first virtual operation panel generated by aclicking operation performed by the virtual object of the interactivedevice in the VR scenario on a close button in the first virtualoperation panel. Optionally, the interactive operation performed by theinteractive device on the target interactive object may be indicated byusing the virtual object in the VR scenario. The interactive operationinstruction performed on the target interactive object may be aninteractive operation instruction for the interactive device to touchthe 2D menu in the first virtual operation panel by using the virtualobject; or may be an interactive operation instruction used for closingthe first virtual operation panel, where the function of closing thefirst virtual operation panel may be encapsulated by a component, forexample, an OptExitComponent; or may be an interactive operationinstruction used for changing the position of the first virtualoperation panel. The posture change of the virtual object in the VRscenario may be controlled by using the interactive device, to controlthe position change of the first virtual operation panel in the VRscenario.

Optionally, in this embodiment, which space in the VR scenario may touchthe virtual object of the interactive device in the VR scenario may bemarked by using a component. For example, the component is anOptInteractiveComponent. The marked region in the VR scenario may beused as a region for the interactive device and the VR scenario toperform interactions.

Step S408. Execute a target event corresponding to the targetinteractive object in the VR scenario in response to the interactiveoperation instruction.

In the technical solution provided in the foregoing step S408 in thisembodiment of this application, the target event corresponding to thetarget interactive object is executed in the VR scenario is response tothe interactive operation instruction.

After the interactive operation instruction generated by the interactiveoperation performed by the interactive device on the target interactiveobject in the interactive object displayed in the first virtualoperation panel is obtained, an interactive result for the interactiveoperation instruction is obtained in response to the interactiveoperation instruction. For example, when the interactive operationinstruction is an interactive operation instruction used for theinteractive device to touch the 2D menu in the first virtual operationpanel by using the virtual object, the interactive result obtained inresponse to the interactive operation instruction is an interactiveresult of interacting with the 2D menu; when the interactive operationinstruction is an interactive operation instruction used for closing thefirst virtual operation panel, the interactive result obtained inresponse to the interactive operation instruction is an interactiveresult of closing the first virtual operation panel; and when theinteractive operation instruction is an interactive operationinstruction used for changing the position of the first virtualoperation panel, the interactive result obtained in response to theinteractive operation instruction is an interactive result of moving theposition of the first virtual operation panel to a new position.

This embodiment may support a plurality of virtual operation panels tobe displayed in the VR scenario, so that combination use and quickswitch between the virtual operation panels also become possible,thereby improving operation flexibility of the virtual operation panel,facilitating user operation, and improving user experience.

By using the foregoing step S402 to step S408, a first target operationinstruction is obtained in a VR scenario; a first virtual operationpanel corresponding to the first target operation instruction isselected and displayed from a plurality of virtual operation panels inthe VR scenario, the plurality of virtual operation panels beingdisplayed mutually independently, and being respectively configured todisplay different interactive objects; an interactive operationinstruction generated by an interactive operation performed by aninteractive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel is obtained, theinteractive device being associated with the VR scenario; and a targetevent corresponding to the target interactive object is executed in theVR scenario in response to the interactive operation instruction. Aplurality of mutually independent virtual operation panels in the VRscenario is respectively configured to display different interactiveinformation, to implement different functions, thereby achieving theobjective of operating the virtual operation panel, improving operationflexibility of the virtual operation panel, and further resolving thetechnical problem of low flexibility information interaction in therelated technology.

In an optional embodiment, step S406 of obtaining an interactiveoperation instruction generated by an interactive operation performed byan interactive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel includes:obtaining a touch operation instruction generated by a touch operationperformed by the interactive device on the target interactive object,where the interactive operation instruction includes the touch operationinstruction, and the touch operation instruction is used for triggeringa target event corresponding to the target interactive object.

In this embodiment, the interactive operation performed by theinteractive device on the target interactive object includes a touchoperation, where the touch operation may be an operation that theinteractive device makes the virtual object in the VR scenario touch thetarget interactive object, for example, the operation that theinteractive device makes the virtual object click or double-click thetarget interactive object. A touch operation instruction generated whenthe interactive device performs the touch operation on the targetinteractive object is obtained, and the target event corresponding tothe target interactive object is triggered by using the touch operationinstruction. For example, the target interactive object is a volumesetting object, a touch operation instruction generated when a virtualhand of the interactive device in the VR scenario performs a touchoperation on the volume setting object is obtained, and a volumeadjustment event corresponding to the volume setting object is triggeredby using the touch operation instruction.

In an optional embodiment, step S408 of executing a target eventcorresponding to the target interactive object in the VR scenario inresponse to the interactive operation instruction includes: obtainingfirst position information of the interactive device during generatingof the touch operation instruction; and executing the target eventcorresponding to the target interactive object triggered by the touchoperation instruction in the VR scenario.

FIG. 5 is a flowchart of a method for executing a target eventcorresponding to a target interactive object in a VR scenario accordingto an embodiment of this application. As shown in FIG. 5, the methodincludes the following steps.

Step S501. Obtain first position information of an interactive deviceduring generating of a touch operation instruction.

In the technical solution provided in the foregoing step S501 in thisembodiment of this application, the first position information of theinteractive device is obtained during generating of the touch operationinstruction, where the first position information is used for indicatinga first position of a virtual object of the interactive device in the VRscenario on the first virtual operation panel.

The interactive device has a corresponding virtual object in the VRscenario, and the virtual object may be used for indicating an operationperformed by the interactive device, where the position of the virtualobject in the VR scenario may be used for indicating a position of aninteractive operation performed by the interactive device in the VRscenario, and may be a virtual hand, or another icon, which is notlimited herein.

After the interactive operation instruction generated by the interactiveoperation performed by the interactive device on the target interactiveobject is obtained, first position information corresponding to theinteractive device during generating of the touch operation instructionin the VR scenario is obtained. The first position information is usedfor indicating a first position when a virtual object corresponding tothe interactive device performs a touch operation on the first virtualoperation panel. The first position is a position at which theinteractive device performs an operation on the first virtual operationpanel, and may correspond to a specific interactive object.

Step S502. Execute, in a case that the first position information meetsa preset condition, the target event corresponding to the targetinteractive object triggered by the touch operation instruction in theVR scenario.

In the technical solution provided in the foregoing step S502 in thisembodiment of this application, in a case that the first positioninformation meets the preset condition, the target event correspondingto the target interactive object triggered by the touch operationinstruction is executed in the VR scenario.

After the first position information of the interactive device isobtained during generating of the touch operation instruction, whetherthe first position information meets the preset condition is determined.When the first position indicated by the first position information isincluded in an interactive region corresponding to the targetinteractive object, it is determined that the first position informationmeets the preset condition, and when the first position indicated by thefirst position information is not included in the interactive regioncorresponding to the target interactive object, it is determined thatthe first position information does not meets the preset condition. In acase that the first position information meets the preset condition, thetarget event corresponding to the target interactive object triggered bythe touch operation instruction is executed in the VR scenario. Forexample, when the first position indicated by the first positioninformation is included in a volume setting button of the volume settingobject, it is determined that the first position information meets thepreset condition, and a volume setting event corresponding to the volumesetting object triggered by the touch operation instruction is executedin the VR scenario.

In this embodiment, during generating of the touch operationinstruction, the first position information used for indicating thefirst position of the virtual object of the interactive device in the VRscenario on the first virtual operation panel is obtained. In a casethat the first position information meets the preset condition, thetarget event corresponding to the target interactive object triggered bythe touch operation instruction is executed in the VR scenario, therebyimplementing the objective of executing the target event correspondingto the target interactive object in the VR scenario in response to theinteractive operation instruction, and avoiding a counter-intuitiveoperation manner implemented by the interactive device by using a rayoperation, so that the user may intuitively touch the interactive objectby using the virtual object of the interactive device in the VRscenario, thereby improving operation flexibility of the virtualoperation panel.

In an optional embodiment, after the obtaining the touch operationinstruction generated by the touch operation performed by theinteractive device on the target interactive object, the method furtherincludes: displaying first feedback information in the VR scenario;and/or outputting second feedback information to the interactive device,where the second feedback information is used for instructing theinteractive device to perform a target operation.

In this embodiment, when the interactive operation is performed,information may be fed back to the user. After obtaining the touchoperation instruction generated by the touch operation performed by theinteractive device on the target interactive object, the first feedbackinformation is displayed in the VR scenario. The first feedbackinformation is used for triggering visions of the user. For example, thetouch operation instruction causes the color of the interactive regionof the virtual object to become darker or lighter, to distinguish fromother regions on which no interactive operation has been performed. Thesecond feedback information may also be outputted to the interactivedevice, where the second feedback information is used for instructingthe interactive device to perform a target operation. Optionally, thetarget operation is a vibration operation, so that the user feels avibration feedback of the interactive device, to determine that theinteractive device has performed the touch operation on the targetinteractive object, and has generated the touch operation instruction.Optionally, the target operation in this embodiment may further be aprompt operation performed by the interactive device by using audioinformation, for example, a voice prompt operation or a prompt toneoperation, which is not limited herein. The voice prompt operation mayenable the user to learn the situation of a currently performed touchoperation by using voice content, for example, the target interactiveobject is a volume setting object. When a volume adjustment eventcorresponding to the volume setting object is triggered by using thetouch operation instruction, the interactive device may output promptvoice “Your currently performed operation is an volume adjustmentoperation” or the like. The prompt tone operation may enable theinteractive device to output a prompt tone, and the prompt tone may be asingle prompt message. When the interactive device has performed thetouch operation on the target interactive object and has generated thetouch operation instruction, the interactive device outputs the prompttone, so that the user quickly senses that the touch operation has beencurrently performed, and the touch operation instruction has beengenerated. Therefore, the user experiences the touch operation performedby the virtual object of the interactive device in the VR scenario onthe target interactive object by using the foregoing manner, andachieving the effect of fully using a more natural and flexibleinteraction manner brought by VR.

In an optional embodiment, step S406 of obtaining an interactiveoperation instruction generated by an interactive operation performed byan interactive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel includes: in acase of detecting that a first gesture performed by the virtual objectof the interactive device in the VR scenario on the first targetinteractive object is a first preset gesture, obtaining a firstinteractive operation instruction generated by a first operationperformed on the first target interactive object, to prepare for movingthe first virtual operation panel; after the first interactive operationinstruction is responded to, obtaining a second interactive operationinstruction generated by a second operation performed on the firstvirtual operation panel, so that the first virtual operation panel movesas the virtual object of the interactive device in the VR scenariomoves; and in a case of detecting that the virtual object of theinteractive device in the VR scenario changes from the first gesture toa second gesture, and the second gesture is a second preset gesture,obtaining a third interactive operation instruction generated by a thirdoperation performed on the first target interactive object, to stopmoving the first virtual operation panel.

FIG. 6 is a flowchart of a method for obtaining an interactive operationinstruction generated by an interactive operation performed by aninteractive device on a target interactive object in an interactiveobject displayed in a first virtual operation panel according to anembodiment of this application. As shown in FIG. 6, the method includesthe following steps.

Step S601. In a case of detecting that a first gesture performed by avirtual object of an interactive device in a VR scenario on a firsttarget interactive object is a first preset gesture, obtain a firstinteractive operation instruction generated by a first operationperformed on the first target interactive object.

In the technical solution provided in the foregoing step S601 in thisembodiment of this application, in a case of detecting that the firstgesture performed by the virtual object of the interactive device in theVR scenario on the first target interactive object is a first presetgesture, the first interactive operation instruction generated by thefirst operation performed on the first target interactive object isobtained, where the interactive operation instruction includes the firstinteractive operation instruction, the first interactive operationinstruction is used for triggering a target event of preparing formoving the first virtual operation panel, and the target interactiveobject includes the first target interactive object.

After the first virtual operation panel corresponding to the firsttarget operation instruction is selected and displayed from theplurality of virtual operation panels in the VR scenario, a collider ofthe virtual object enters a panel collider. Whether the first gestureperformed by the virtual object on the first target interactive objectis a first preset gesture is detected. The first target interactiveobject may be any interactive region in the first virtual operationpanel, and the first preset gesture may be a grasp gesture. That is, aslong as the virtual object performs the touch operation on the firstvirtual operation panel, whether the first gesture is a grasp gesture isdetected. In a case that the first gesture is a first preset gesture, afirst operation instruction generated by a first operation performed onthe first target object is obtained. The first operation is a graspoperation of the virtual object. The user may press a grasp buttondisposed on the interactive device to control the virtual object toperform a grasp operation on the first virtual operation panel. Thetarget event of preparing for moving the first virtual operation panelis executed in the VR scenario in response to the first interactiveoperation instruction, that is, the first virtual operation panel is ina movable state in the VR scenario, instead of being fixed in the VRscenario.

Step S602. Obtain a second interactive operation instruction generatedby a second operation performed on a first virtual operation panel inresponse to the first interactive operation instruction.

In the technical solution provided in the foregoing step S602 in thisembodiment of this application, after the first interactive operationinstruction is responded to, the second interactive operationinstruction generated by the second operation performed on the firstvirtual operation panel is obtained, where the interactive operationinstruction includes the second interactive operation instruction, thesecond interactive operation instruction is used for triggering a targetevent that the first virtual operation panel moves as the virtual objectof the interactive device in the VR scenario moves.

After the first interactive operation instruction is responded to, thefirst virtual operation panel may move in the VR scenario. The secondinteractive operation instruction generated by the second operationperformed on the first virtual operation panel is obtained. The secondoperation is a moving operation of the virtual object. The user maypress the grasp button disposed on the interactive device all the timeto control the virtual object to perform the moving operation on thefirst virtual operation panel. The target event that the first virtualoperation panel moves as the virtual object of the interactive device inthe VR scenario moves triggered by the second operation instruction isexecuted in the VR scenario in response to the second operationinstruction, so that the first virtual operation panel moves in the VRscenario according to the operation of the user for the interactivedevice, instead of being fixed in the VR scenario.

Step S603. In a case of detecting that the gesture performed by thevirtual object of the interactive device in the VR scenario on the firsttarget interactive object changes from the first gesture to a secondgesture, and the second gesture is a second preset gesture, obtain athird interactive operation instruction generated by a third operationperformed on the first target interactive object.

In the technical solution provided in the foregoing step S603 in thisembodiment of this application, in a case that it is detected that thegesture performed by the virtual object of the interactive device in theVR scenario on the first target interactive object changes from thefirst gesture to the second gesture, and the second gesture is a secondpreset gesture, the third interactive operation instruction generated bythe third operation performed on the first target interactive object isobtained, where the interactive operation instruction includes the thirdinteractive operation instruction, and the third interactive operationinstruction is used for triggering a target event that the virtualobject of the interactive device in the VR scenario stops moving thefirst virtual operation panel.

In a moving process of the first virtual operation panel in the VRscenario, whether the gesture performed by the virtual object on thefirst target interactive object changes, and whether the gesture changesfrom the first gesture to the second gesture are detected. The secondgesture is a second preset gesture, for example, the second presetgesture is a loosening gesture of the target object. If the gesturechanges from the first gesture to the second preset gesture, the thirdinteractive operation instruction generated by the third operationperformed on the first target interactive object is obtained. The thirdoperation may be a loosening operation, that is, a release operation onthe first virtual operation panel. The user may loosen the grasp buttondisposed on the interactive device all the time to control the virtualobject to perform the release operation on the first virtual operationpanel. The target event that the virtual object of the interactivedevice in the VR scenario stops moving the first virtual operation paneltriggered by the third interactive operation instruction is executed inthe VR scenario in response to the third interaction instruction, sothat the first virtual operation panel remains at the position when thegesture performed by the virtual object on the first target interactiveobject is the second gesture.

In this embodiment, in a case that it is detected that the first gestureperformed by the virtual object of the interactive device in the VRscenario on the first target interactive object is a first presetgesture, the first interactive operation instruction generated by thefirst operation performed on the first target interactive object isobtained, to trigger the target event of preparing for moving the firstvirtual operation panel; the second interactive operation instructiongenerated by the second operation performed on the first virtualoperation panel is obtained, to trigger the target event that the firstvirtual operation panel moves as the virtual object of the interactivedevice in the VR scenario moves; in a case that it is detected that thegesture performed by the virtual object of the interactive device in theVR scenario on the first target interactive object changes from thefirst gesture to the second preset gesture, the third interactiveoperation instruction generated by the third operation performed on thefirst target interactive object is obtained, and the target event thatthe virtual object of the interactive device in the VR scenario stopsmoving the first virtual operation panel is triggered, so that the firstvirtual operation panel may be disposed on an interactive region in theVR scenario according to needs of the user, the first virtual operationpanel may be prevented from blocking the sight of the user, and userscan develop their own operation habits, thereby improving operationflexibility of the virtual operation panel.

In an optional embodiment, step S408 of executing a target eventcorresponding to the target interactive object in the VR scenario inresponse to the interactive operation instruction includes: obtainingsecond position information of the interactive device during generatingof the third interactive operation instruction; determining a regionincluding a second position in the VR scenario as a target displayregion of the first virtual operation panel; and displaying the firstvirtual operation panel in the target display region.

FIG. 7 is a flowchart of another method for executing a target eventcorresponding to a target interactive object in a VR scenario accordingto an embodiment of this application. As shown in FIG. 7, the methodincludes the following steps.

Step S701. Obtain second position information of an interactive deviceduring generating of a third interactive operation instruction.

In the technical solution provided in the foregoing step S701 in thisembodiment of this application, the second position information of theinteractive device is obtained during generating of the thirdinteractive operation instruction, where the second position informationis used for indicating a second position of a virtual object of theinteractive device in the VR scenario.

After the third interactive operation instruction generated by the thirdoperation performed on the first target interactive object is obtained,the second position information of the interactive device duringgenerating of the third interactive operation instruction is obtained.The second position information is used for indicating the secondposition of the virtual object corresponding to the interactive devicein the VR scenario. For example, after a release operation instructiongenerated by a release operation performed on the first virtualoperation panel is obtained, a second position of a virtual handcorresponding to the interactive device during generating of the releaseoperation instruction is obtained.

Step S702. Determine a region including the second position in the VRscenario as a target display region of the first virtual operationpanel.

In the technical solution provided in the foregoing step S702 in thisembodiment of this application, the region including the second positionin the VR scenario is determined as the target display region of thefirst virtual operation panel.

After the second position information is obtained, the region includingthe second position in the VR scenario is determined. The region is thetarget display region of the first virtual operation panel. The size ofthe target display region is larger than the size of the first virtualoperation panel, so that content on the first virtual operation panelmay be completely displayed.

Step S703. Display the first virtual operation panel in the targetdisplay region.

In the technical solution provided in the foregoing step S703 in thisembodiment of this application, after the target display region of thefirst virtual operation panel is determined, the first virtual operationpanel is displayed in the target display region, where the target eventincludes the event of displaying the first virtual operation panel inthe target display region.

In this embodiment, the second position information of the interactivedevice is obtained during generating of the third interactive operationinstruction, where the second position information is used forindicating the second position of the virtual object of the interactivedevice in the VR scenario; the region including the second position inthe VR scenario is determined as the target display region of the firstvirtual operation panel; and the first virtual operation panel isdisplayed in the target display region, thereby achieving the objectiveof executing the target event corresponding to the target interactiveobject in the VR scenario in response to the interactive operationinstruction.

In an optional embodiment, in step S602, during the obtaining the secondinteractive operation instruction performed on a second operationperformed by the first virtual operation panel, the method furtherincludes: controlling the first virtual operation panel to be towards apreset direction in a moving process in the VR scenario.

In this embodiment, when the second interactive operation instructiongenerated by the second operation performed on the first virtualoperation panel is obtained, that is, when the first virtual operationpanel moves as the virtual object of the interactive device in the VRscenario moves, the first virtual operation panel is controlled to betowards a preset direction in a moving process in the VR scenario.Optionally, in the moving process, the first virtual operation panel isalways in a direction of the head of the user, so that the user mayclearly see the content displayed on the first virtual operation panel,until the user controls, by using the interactive device, the virtualobject to release the first virtual operation panel, and the firstvirtual operation panel remains at a new spatial position at which itremains during the release. Then the process ends.

In an optional embodiment, in step S408, before the interactiveoperation instruction is responded to, the method further includes:obtaining a second target operation instruction in the VR scenario;selecting and displaying at least one second virtual operation panelcorresponding to the second target operation instruction from theplurality of virtual operation panels in the VR scenario; and obtainingan interactive operation instruction generated by an interactiveoperation performed by the interactive device on a target interactiveobject in an interactive object displayed in the first virtual operationpanel and the at least one second virtual operation panel.

FIG. 8 is a flowchart of another information interaction methodaccording to an embodiment of this application. As shown in FIG. 8, themethod further includes the following steps.

Step S801. Obtain a second target operation instruction in a VRscenario.

In the technical solution provided in the foregoing step S801 in thisembodiment of this application, the second target operation instructionis obtained in the VR scenario.

This embodiment supports simultaneous display of a plurality of virtualoperation panels. Before the interactive operation instruction isresponded to, the second target operation instruction is obtained in theVR scenario. The second target operation instruction may be aninstruction used for selecting a to-be-operated virtual operation panelin addition to the first virtual operation panel in the VR scenario. Theuser may generate the second target operation instruction by operatingan interactive device, for example, moving a rocker on the interactivedevice, controlling a virtual object in the VR scenario to move,pressing a button on a handle after the to-be-operated virtual operationpanel is determined, and controlling the virtual object to click thevirtual operation panel, thereby generating the second target operationinstruction.

Step S802. Select and display at least one second virtual operationpanel corresponding to the second target operation instruction from aplurality of virtual operation panels in the VR scenario.

In the technical solution provided in the foregoing step S802 in thisembodiment of this application, the at least one second virtualoperation panel corresponding to the second target operation instructionis selected and displayed from the plurality of virtual operation panelsin the VR scenario.

In this embodiment, a plurality of virtual operation panels is disposedin the VR scenario, and the plurality of virtual operation panels areindependently displayed, and may display different content.

After the second target operation instruction is obtained, the at leastone second virtual operation panel corresponding to the second targetoperation instruction is selected and displayed from the plurality ofvirtual operation panels in the VR scenario. After the second targetoperation instruction is generated by using the interactive device, atleast one second virtual operation panel corresponding to the secondtarget operation instruction may be selected and displayed from theplurality of virtual operation panels in response to the second targetoperation instruction. Optionally, when the virtual object is controlledby using the interactive device to touch the virtual operation panel, itis determined that the second virtual operation panel in the pluralityof virtual operation panels is selected, or when the virtual object iscontrolled by using the interactive device to touch a preset selectedbutton on the virtual operation panel, it is determined that the secondvirtual operation panel in the plurality of virtual operation panels isselected, and the second virtual operation panel is displayed to displaycontent of the second virtual operation panel.

Optionally, the first virtual operation panel and the at least onesecond virtual operation panel may be virtual operation panels having anassociation relationship, and may be the same type of virtual operationpanels, for example, social virtual operation panels, virtual operationpanels including an email system, virtual operation panels of a friendsystem, and virtual operation panels configured for communication.

Step S803. Obtain an interactive operation instruction generated by aninteractive operation performed by the interactive device on a targetinteractive object in an interactive object displayed in the firstvirtual operation panel and the at least one second virtual operationpanel.

In the technical solution provided in the foregoing step S803 in thisembodiment of this application, the interactive operation instructiongenerated by the interactive operation performed by the interactivedevice on the target interactive object in the interactive objectdisplayed in the first virtual operation panel and the at least onesecond virtual operation panel is obtained.

After the at least one second virtual operation panel corresponding tothe second target operation instruction is selected and displayed fromthe plurality of virtual operation panels in the VR scenario, theinteractive operation instruction generated by the interactive operationperformed by the interactive device on the target interactive object inthe interactive object displayed in the first virtual operation paneland the at least one second virtual operation panel is obtained. Becausethe first virtual operation panel and the at least one second virtualoperation panel have an association relationship, the plurality ofvirtual operation panels may be mutually combined, and may meet at anytime an interactive operation that the user needs to implement in aninteractive operation process, to enhance interactive experience of theuser in the interactive operation process, so that the user can selectthe virtual operation panel flexibly, and further switch betweendifferent virtual operation panels and different interactive operationfunctions, thereby improving operation flexibility of the virtualoperation panel.

In this embodiment, before the interactive operation instruction isresponded to, the second target operation instruction is obtained in theVR scenario; the at least one second virtual operation panelcorresponding to the second target operation instruction is selected anddisplayed from the plurality of virtual operation panels in the VRscenario; and the interactive operation instruction generated by theinteractive operation performed by the interactive device on the targetinteractive object in the interactive object displayed in the firstvirtual operation panel and the at least one second virtual operationpanel is obtained, thereby improving operation flexibility of thevirtual operation panel.

In an optional embodiment, step S406 of obtaining an interactiveoperation instruction generated by an interactive operation performed bythe interactive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel includes:obtaining a fourth interactive operation instruction generated by aninteractive operation performed by the interactive device on a thirdtarget interactive object displayed in the first virtual operationpanel; and step S408 of executing a target event corresponding to thetarget interactive object in the VR scenario in response to theinteractive operation instruction includes: executing a target event ofclosing the first virtual operation panel triggered by the fourthinteractive operation instruction in the VR scenario in response to thefourth interactive operation instruction.

FIG. 9 is a flowchart of another information interaction methodaccording to an embodiment of this application. As shown in FIG. 9, themethod includes the following steps.

Step S901. Obtain a fourth interactive operation instruction generatedby an interactive operation performed by an interactive device on athird target interactive object displayed in a first virtual operationpanel.

In the technical solution provided in the foregoing step S901 in thisembodiment of this application, the fourth interactive operationinstruction generated by the interactive operation performed by theinteractive device on the third target interactive object displayed inthe first virtual operation panel is obtained, where the targetinteractive object includes the third target interactive object, theinteractive operation instruction includes the fourth interactiveoperation instruction, and the fourth interactive operation instructionis used for triggering a target event of closing the first virtualoperation panel.

The first virtual operation panel includes the third target interactiveobject, which may be a target interactive object having a “×” mark, toindicate that the first virtual operation panel may be closed by using avirtual object (such as a virtual hand) of the interactive device in theVR scenario. For example, the virtual object performs a touch operationon the “×” mark in the top right corner of the first virtual operationpanel, to generate the fourth interactive operation instruction, totrigger the target event of closing the first virtual operation panel.

Step S902. Execute a target event of closing the first virtual operationpanel triggered by the fourth interactive operation instruction in theVR scenario in respond to the fourth interactive operation instruction.

In the technical solution provided in the foregoing step S902 in thisembodiment of this application, the target event of closing the firstvirtual operation panel triggered by the fourth interactive operationinstruction is executed in the VR scenario in response to the fourthinteractive operation instruction.

After the fourth interactive operation instruction generated by theinteractive operation performed by the interactive device on the thirdtarget interactive object is obtained, and the target event of closingthe first virtual operation panel triggered by the fourth interactiveoperation instruction is executed in the VR scenario in response to thefourth interactive operation instruction, to close the first virtualoperation panel.

Optionally, an OptExitComponent encapsulates the close function of thevirtual operation panel, and the user may click the OptExitComponent byusing the virtual object of the interactive device in the VR scenario,to destroy the entire virtual operation panel in the VR scenario.

In this embodiment, the fourth interactive operation instructiongenerated by the interactive operation performed by the interactivedevice on the third target interactive object displayed in the firstvirtual operation panel, and the target event of closing the firstvirtual operation panel triggered by the fourth interactive operationinstruction is executed in the VR scenario in response to the fourthinteractive operation instruction, to close the first virtual operationpanel.

In an optional embodiment, in step S404, before the selecting anddisplaying a first virtual operation panel corresponding to the firsttarget operation instruction from a plurality of virtual operationpanels in the VR scenario, the method further includes: obtaining a 2Dinterface including an interactive object; and combining the 2Dinterface and a mesh model in the VR scenario, to obtain the firstvirtual operation panel.

FIG. 10 is a flowchart of another information interaction methodaccording to an embodiment of this application. As shown in FIG. 10, themethod further includes the following steps.

Step S1001. Obtain a 2D interface including an interactive object.

In the technical solution provided in the foregoing step S1001 in thisembodiment of this application, before the first virtual operation panelcorresponding to the first target operation instruction is selected anddisplayed from the plurality of virtual operation panels in the VRscenario, the 2D interface including the interactive object is obtained.

Before the first virtual operation panel corresponding to the firsttarget operation instruction is selected and displayed from theplurality of virtual operation panels in the VR scenario, a 2D UI (UMGWidget) including an interactive object is obtained.

Step S1002. Combine the 2D interface and a mesh model in a VR scenario,to obtain a first virtual operation panel.

In the technical solution provided in the foregoing step S1002 in thisembodiment of this application, the 2D interface and the mesh model inthe VR scenario are combined, to obtain the first virtual operationpanel, where the mesh model is configured to mark a region used forexecuting an interactive operation in the VR scenario.

After the 2D interface including the interactive object is obtained, the2D interface may be combined with the mesh model in the VR scenario byusing a preset component, to obtain the first virtual operation panel.For example, if the preset component is a WidgetComponent, and the meshmodel is a 3D mesh, the 2D UI is attached on the 3D mesh by using theWidgetComponent. After the 2D UI including the interactive object isattached on the 3D mesh, the user may control, by using the interactivedevice, the virtual object in the virtual scenario to interact with the2D UI, and the size of the 3D mesh is determined by the size of the 2DUI.

In this embodiment, before the first virtual operation panelcorresponding to the first target operation instruction is selected anddisplayed from the plurality of virtual operation panels in the VRscenario, the 2D interface including the interactive object is obtained;and the 2D interface and the mesh model in the VR scenario are combinedto implement the first virtual operation panel configured to perform aninteractive operation in the VR scenario, thereby achieving the effectof integrating the original 2D UI into an entity mesh model in thescenario perfectly.

In an optional embodiment, step S406 of obtaining an interactiveoperation instruction generated by an interactive operation performed byan interactive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel includes:obtaining, in a case that a collider of the first virtual operationpanel and a collider of the virtual object of the interactive device inthe VR scenario intersect, the interactive operation instructionperformed by the interactive device on the target interactive object inthe interactive object displayed in the first virtual operation panel.

The interactive operation instruction is generated in a case that thecollider of the first virtual operation panel and the collider of thevirtual object of the interactive device in the VR scenario intersect,and the following interactive operations are detected on each frame:first, if the virtual object clicks a 2D UI mounted on a 3D mesh,whether some logic events of the UI are triggered, for example, an eventof pressing a button is triggered, is determined according to a detectedposition clicked by the virtual object; second, if the virtual objectclicks the close button, a destruction logic of the panel is triggered,and after this step is completed, the entire logic interacting with thepanel cuts off; third, if the user wants to adjust the position of thepanel, a grasp operation of the virtual object is triggered, the virtualoperation panel moves as the virtual object moves in the spatialposition, and the virtual operation panel always rotates towards thedirection of the head of the user, so that the user can always clearlysee the content displayed on the virtual operation panel, until thevirtual object is controlled to release the virtual operation panel, andthe virtual operation panel remains at a new spatial position; andfourth, if the virtual object is controlled to leave the interactiveregion of the virtual operation panel, the interactive operation logicis no longer executed.

In this embodiment, the OptInteractiveComponent is also a 3D mesh,configured to mark which relative space in the VR scenario may collidewith the virtual object (such as the virtual hand) of the interactivedevice in the VR scenario, and an implementation logic of a collisionevent may be implemented by using the InteractiveBaseComponent.

In an optional embodiment, the size of each of the plurality of virtualoperation panels is determined by the target interactive objectdisplayed on each virtual operation panel, that is, the size of eachvirtual operation panel in the VR scenario is determined according theamount of the content.

In this embodiment, in a process of playing a game, options of the menucan be used without pausing the game, to improve operation flexibilityof the menu panel, so that users can develop their own operation habits.

The following describes the technical solutions of this application withreference to optional embodiments. An example in which the virtualobject of the interactive device in the VR scenario is a virtual hand isused for description.

FIG. 11 is a schematic diagram of an implementation structure of asingle panel according to an embodiment of this application. FIG. 11shows an implementation structure of an INFORMATION panel. The panelcomponent is the column of left components, mainly including: aRootComponent, a WidgetComponent, an OptInteractiveComponent, anInteractiveBaseComponent, an OptExitComponent, and a SolarMeshWidgetcomponent from top to bottom sequentially.

The RootComponent is a root node, which is not endowed with a logic; theWidgetComponent (inherited) is a component implemented in thisembodiment and configured to attach a conventional 2D user interface (2DUI) (by using a universal media gateway widget (UMG Widget)) on anentity mesh model (3D mesh), and after the 2D UI is attached on the 3DMesh, the user may interact with the 2D UI by using the interactivedevice, and the size of the entity mesh model (3D mesh) may bedetermined by the size of the 2D UI; the OptInteractiveComponent is alsoa 3D mesh, configured to mark which relative space in the VR scenariomay collide with the interactive device, and an implementation logic ofa collision event may be implemented in the InteractiveBaseComponent;the OptExitComponent is configured to encapsulate a close function of amenu panel, and when the user clicks the component by using theinteractive device, objects on the entire menu panel are destroyed; theSolarMeshWidget is an additional component, that is, some additionalcomponents may be added on the menu panel on the basis of the foregoingcomponents according to needs, so that the menu panel has strongerfunctions, but the WidgetComponent (inherited) needs to mark basicfunctions, thereby meeting basic display (2D UI display) on the menupanel and implementing interactions between the basic functions, wherethe interactions between the basic functions may be an operationclicking function, an operation closing function, and a positionadjusting operation function on the UI, which are not limited herein.

In this embodiment, the original 2D UI is further perfectly integratedinto the entity mesh model in the VR scenario. Meanwhile, interactiveexperience of a sense of touch is brought to users, to increaseimmersive feelings to the users.

In the implementation structure of the single panel in this embodiment,other information in addition to the foregoing information is onlyexemplary, and it does not mean that the solutions in this embodiment ofthis application are limited.

The following describes the operation logic of the menu panel.

FIG. 12 is a flowchart of another information interaction methodaccording to an embodiment of this application. As shown in FIG. 12, themethod includes the following steps.

Step S1201. Control, by using an interactive device, a collider of avirtual hand to enter a panel collider.

In this embodiment, a logic implementation method operated by the userby using the interactive device is displayed. All logic detections areperformed when the user controls, by using the interactive device, thecollider of the virtual hand and a collider of a menu panel tointersect. The virtual hand is a virtual object of the interactivedevice in the VR scenario. The collider of the virtual hand enters thepanel collider by using the interactive device.

Step S1202. Switch an action of the virtual hand to a clicking gestureby using the interactive device.

After a hand collider enters the panel collider by using the interactivedevice, the user switches the action of the virtual hand to the clickinggesture by using keys configured to execute the clicking gesture on theinteractive device.

Step S1203. Detect an operation corresponding to the clicking gesture ofthe virtual hand.

After the action of the virtual hand is switched to the clicking gestureby using the interactive device, the operation corresponding to theclicking gesture of the virtual hand is detected.

Step S1204. Click a 2D UI by using the interactive device.

The 2D UI attached on the 3D mesh is clicked by using the interactivedevice.

Step S1205. Obtain a clicking position.

The clicking position is obtained after the 2D UI is clicked by usingthe interactive device.

Step S1206. Confirm a clicking object by using the interactive device,and execute the logic.

After the clicking position is obtained, the clicking object isconfirmed according to the detected clicking position, and whether somelogic events of the UI are triggered is determined. For example, whetheran event of pressing a button is triggered is determined, and the logicis executed. After the clicking object is confirmed by using theinteractive device, and the logic is executed, step S1203 may beperformed again, to detect the operation corresponding to the clickinggesture of the virtual hand.

Step S1207. Control, by using the interactive device, the virtual handto click a close button on the menu panel.

Step S1208. Destroy the menu panel by using the interactive device.

After the button is closed by using the interactive device, theoperation instruction corresponding to the destruction logic of the menupanel is triggered, and after the operation instruction is responded to,the entire interaction logic with the menu panel ends, and the menupanel is destroyed. After the menu panel is destroyed, step S1203 may beperformed again, to detect the operation corresponding to the clickinggesture of the virtual hand.

Step S1209. Control, by using the interactive device, the virtual handto receive a grasp operation instruction.

After the operation corresponding to the clicking gesture of the virtualhand is detected, when the user wants to adjust the position of the menupanel in the VR scenario by using the interactive device, the virtualhand is controlled by using the interactive device to trigger anoperation instruction used for grasping the menu panel.

Step S1210. Switch the action of the virtual hand to a grasp gesture byusing the interactive device.

After the grasp operation instruction is received by using theinteractive device, the action of the virtual hand is switched to thegrasp gesture in response to the operation instruction.

Step S1211. Control, by using the interactive device, the position ofthe menu panel to move, where the panel direction of the menu is alwaystowards a head position of a user.

After the action of the virtual hand is switched to the grasp gesture byusing the interactive device, the position of the menu panel iscontrolled by using the interactive device to move, so that the menupanel moves as the virtual hand of the interactive device in the virtualscenario moves, and the direction of the menu panel is always towardsthe head position of the user, that is, the user can always clearly seethe content displayed on the menu panel.

Step S1212. The user triggers an operation release instruction by usingthe interactive device.

Step S1213. Control, by using the interactive device, the menu panel toremain at the position released by the hand.

After the user triggers the operation release instruction by using theinteractive device, the menu panel remains at a new spatial position inthe VR scenario, where the spatial position is the position at which theuser expects the menu panel to remain in the VR scenario.

Step S1214. Control, by using the interactive device, the hand action toswitch to the clicking gesture.

After the menu panel is controlled by using the interactive device toremain at the position released by the hand, the hand action may becontrolled by using the interactive device to switch to the clickinggesture. After the hand action is controlled by using the interactivedevice to switch to the clicking gesture, step S1203 may be performedagain, to detect the operation corresponding to the clicking gesture ofthe virtual hand.

Step S1215. Control, by using the interactive device, the collider ofthe virtual hand to leave the collider of the menu panel.

After the operation corresponding to the clicking gesture of the virtualhand is detected, the collider of the virtual hand is controlled byusing the interactive device to leave the collider of the menu panel,and the virtual hand leaves the interactive region of the menu panel, sothat the operation on the menu panel is no longer performed.

Step S1216. Control, by using interactive device, the action of thevirtual hand to switch to a free gesture.

After the hand collider is controlled by using the interactive device toleave the collider of the menu panel, the collider of the virtual handis controlled by using the interactive device to leave the collider ofthe menu panel. After the action of the virtual hand is controlled byusing the interactive device to switch to the free gesture, step S1203may be performed again, to detect the operation corresponding to theclicking gesture of the virtual hand.

The foregoing logic detections are all performed by the user when thecollider of the virtual object of the interactive device and thecollider of the menu panel intersect, and whether the foregoing fourcases occur is detected for each frame. In step S1203, after theoperation corresponding to the clicking gesture of the virtual hand isdetected, if none of the foregoing four cases occur, step S1203continues to be performed.

In this embodiment, an independently displayed menu panel havingdifferent content is disposed in the VR scenario, thereby fully usingthe advantage of spatial expansion in the VR environment, and avoidingdisplaying the menu by using a display manner of folding menu content inthe 2D space. The menu panel in this embodiment may be disposed at atouchable position around the user, the user may grasp any menu panel byusing the interactive device and put the menu panel to a place where theuser wants to put, thereby integrating the menu panel and the gamescenario, and preventing the menu panel from blocking the sight of theuser, so that users can develop their own operation habits. In addition,the content on the menu panel may be triggered by using the touchoperation instruction of the interactive device, and a vision and touchvibration feedback is further brought to users, thereby fully using amore natural interaction manner brought by VR, and improving userexperience. This embodiment further supports coexistence of a pluralityof menu panels, achieving the objective of combination use and quickswitch between the menu panels.

For an application environment in this embodiment of this application,reference may be made to, but not limited to, the applicationenvironment in the foregoing embodiment, which is not described hereinagain in this embodiment. The embodiments of this application provide anoptional application configured to implement the information interactionmethod.

FIG. 13 is a schematic diagram of menu panel display in a VR scenarioaccording to an embodiment of this application. As shown in FIG. 13, themenu panel is a menu panel displayed when a user actively opens aninterface by using an interactive device. Optionally, during opening ofthe interface, the displayed menu panel is a default menu panel, and thetype and quantity of the default menu panels may be preset, for example,an INFORMATION display panel is preset, and may be configured to setdisplayed information; an EXPRESSION panel, including a plurality typesof different expressions, for the user to select; a SETTINGS panel, maybe configured to set volume of voice. After the setting, when the useropens the interface by using the interactive device, the informationdisplay panel, the expression panel, and the setting panel areindependently displayed, for the user to use when the interactiveoperation is performed by using the interactive device, thereby fullyusing the advantage of spatial expansion brought by the VR environment,instead of folding the menu content in the 2D space. When the usercontrols, by using the interactive device, the virtual hand to click the“×” button on the menu panel, the clicked menu panel is destroyed in theVR scenario. The virtual hand is displayed in the VR scenario, and usedfor indicating the operation of the interactive device.

FIG. 14 is a schematic diagram of interacting with a menu panel in a VRscenario according to an embodiment of this application. FIG. 14 is abasic operation of a menu panel, and the size of each menu panel isdetermined by the amount of the content. The menu panel displayed on themenu panel is 2D, and may be a common UMG Widget in a 3D game. That is,the menu panel in this embodiment is completely compatible with thecurrent game making manner. As long as a 2D menu interface is made, themenu interface may be attached on the menu panel in this embodiment, andthe user may see the menu panel shown in FIG. 14 in the game andinteract with the menu panel by using the virtual hand. Objects used forinteractions such as a button of the 2D menu interface may be clicked bycontrolling fingers of the virtual hand by using the interactive device,to implement the function corresponding to the button.

FIG. 15 is a schematic diagram of interacting with a menu panel inanother VR scenario according to an embodiment of this application. Asshown in FIG. 15, the menu panel may be disposed at any touchable placearound the user. When the user wants to adjust the position of the menupanel in the VR scenario, the user presses the grasp button on theinteractive device, and controls the virtual object to grasp the menupanel. In this case, the virtual menu panel moves as the interactivedevice controls the virtual object to move in the VR scenario. The userreleases the grasp button on the interactive device, to remain the menupanel at a new position in the VR scenario. The new position is theposition at which the user expects the menu panel to remain, therebyimplementing the position change of the menu panel, and resolving theintegration problem of between the menu panel and the game scenario, sothat the menu panel in the VR scenario is convenient for the user totouch by using the interactive device, thereby preventing the menu panelfrom blocking the sight of the user, so that in a process of playing agame, options of the menu can be used without pausing the game, therebyimproving operation flexibility of the menu panel, so that users candevelop their own operation habits.

In addition, content on all menu panels in this embodiment may betriggered in a manner of controlling the virtual object by using theinteractive device to touch, and a vision and touch vibration feedbackis further brought to users, thereby fully using a more naturalinteraction manner brought by VR, and improving user experience. Thecoexistence of a plurality of menu panels is further supported, so thatcombination use and quick switch between panels also become possible,and immersive feelings of the users are enhanced.

This embodiment may support Vive and Oculus Touch in hardware, and maysupport any hand-separated handle that may obtain the position of the 3Dspace.

The content of the menu panel in this embodiment is not limited, and thevisual representation form of the menu panel may also be various, andnot limited.

For simple descriptions, the foregoing method embodiments are stated asa series of action combinations. However, a person skilled in the artshould know that this application is not limited to the sequence of thedescribed actions because according to this application, some steps mayuse another sequence or may be simultaneously performed. In addition, aperson skilled in the art should also know that all the embodimentsdescribed in this specification are optional embodiments, and therelated actions and modules are not necessarily required in thisapplication.

Based on the foregoing descriptions of the embodiments, a person skilledin the art may clearly understand that the method in the foregoingembodiments may be implemented by software in addition to a necessaryuniversal hardware platform or by hardware only. However, the former isa better implementation in most cases. Based on such an understanding,the technical solutions of this application essentially or the partcontributing to the related technology may be implemented in a form of asoftware product. The computer software product is stored in a storagemedium (such as a ROM/RAM, a magnetic disk, or an optical disc) andincludes several instructions for instructing a terminal device (whichmay be a mobile phone, a computer, a server, a network device, or thelike) to perform the methods described in the embodiments of thisapplication.

According to the embodiments of this application, an informationinteraction apparatus configured to implement the foregoing informationinteraction method is further provided. FIG. 16 is a schematic diagramof an information interaction apparatus according to an embodiment ofthis application. As shown in FIG. 16, the apparatus may include: afirst obtaining unit 10, a display unit 20, a second obtaining unit 30,and a response unit 40.

The first obtaining unit 10 is configured to obtain a first targetoperation instruction in a VR scenario.

The display unit 20 is configured to select and display a first virtualoperation panel corresponding to the first target operation instructionfrom a plurality of virtual operation panels in the VR scenario, theplurality of virtual operation panels being displayed mutuallyindependently, and being respectively configured to display differentinteractive objects.

The second obtaining unit 30 is configured to obtain an interactiveoperation instruction generated by an interactive operation performed byan interactive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel, the interactivedevice being associated with the VR scenario.

The response unit 40 is configured to execute a target eventcorresponding to the target interactive object in the VR scenario inresponse to the interactive operation instruction.

The first obtaining unit 10 in this embodiment may be configured toperform step S402 in this embodiment of this application, the displayunit 20 in this embodiment may be configured to perform step S404 inthis embodiment of this application, the second obtaining unit 30 inthis embodiment may be configured to perform step S406 in thisembodiment of this application, and the response unit 40 in thisembodiment may be configured to perform step S408 in this embodiment ofthis application.

Examples and application scenarios implemented by the foregoing unitsand corresponding steps are the same but are not limited to the contentdisclosed in the foregoing embodiments. The foregoing modules may run inthe hardware environment shown in FIG. 1 as a part of the apparatus, maybe implemented by using software, or may be implemented by usinghardware.

In this embodiment, the first obtaining unit 10 obtains a first targetoperation instruction in a VR scenario; the display unit 20 selects anddisplays a first virtual operation panel corresponding to the firsttarget operation instruction from a plurality of virtual operationpanels in the VR scenario, the plurality of virtual operation panelsbeing displayed mutually independently, and being respectivelyconfigured to display different interactive objects; the secondobtaining unit 30 obtains an interactive operation instruction generatedby an interactive operation performed by an interactive device on atarget interactive object in an interactive object displayed in thefirst virtual operation panel, the interactive device being associatedwith the VR scenario; and the response unit 40 executes a target eventcorresponding to the target interactive object in the VR scenario inresponse to the interactive operation instruction. A plurality ofmutually independent virtual operation panels in the VR scenario isrespectively configured to display different interactive information, toimplement different functions, thereby achieving the objective ofoperating the virtual operation panel, improving operation flexibilityof the virtual operation panel, and further resolving the technicalproblem of low flexibility information interaction in the relatedtechnology.

Examples and application scenarios implemented by the foregoing unitsand corresponding steps are the same but are not limited to the contentdisclosed in the foregoing embodiments. The foregoing modules may be runin the hardware environment shown in FIG. 1 as a part of the apparatus,and may be implemented through software, or may be implemented throughhardware. The hardware environment includes a network environment.

According to an embodiment of this application, an electronic apparatusconfigured to implement the foregoing information interaction method isfurther provided.

FIG. 17 is a structural block diagram of an electronic apparatusaccording to an embodiment of this application. As shown in FIG. 17, theelectronic apparatus may include: one or more (only one is shown in thefigure) processors 171 and memories 173. Optionally, as shown in FIG.17, the electronic apparatus may further include a transmissionapparatus 175 and an input/output device 177.

The memory 173 may be configured to store a software program and amodule, for example, a program instruction/module corresponding to aninformation interaction method and apparatus in the embodiments of thisapplication. The processor 171 performs various functional applicationsand data processing by running the software program and the modulestored in the memory 173, that is, implementing the foregoinginformation interaction method. The memory 173 may include a high-speedrandom memory, and may also include a nonvolatile memory such as one ormore magnetic storage apparatuses, a flash memory, or anothernonvolatile solid-state memory. In some instances, the memory 173 mayfurther include a memory that is remotely disposed relative to theprocessor 171, and the remote memory may be connected to the electronicapparatus through a network. Examples of the network include, but arenot limited to, the Internet, an intranet, a local area network, amobile communications network, and a combination thereof.

The transmission apparatus 175 is configured to receive or transmit datathrough a network, and may further be configured for data transmissionbetween the processor and the memory. Examples of the network mayinclude a wired network and a wireless network. In an embodiment, thetransmission apparatus 175 includes a network interface controller (NIC)that may be connected to another network device and a router through anetwork cable, thereby communicating with the Internet or a local areanetwork. In an example, the transmission apparatus 175 is a radiofrequency (RF) module, and is configured to wirelessly communicate withthe Internet.

Optionally, the memory 173 is configured to store an applicationprogram.

The processor 171 may invoke, by using the transmission apparatus 175,the application program stored in the memory 173, so as to perform thefollowing steps:

-   -   obtaining a first target operation instruction in a VR scenario;    -   selecting and displaying a first virtual operation panel        corresponding to the first target operation instruction from a        plurality of virtual operation panels in the VR scenario, the        plurality of virtual operation panels being displayed mutually        independently, and being respectively configured to display        different interactive objects;    -   obtaining an interactive operation instruction generated by an        interactive operation performed by an interactive device on a        target interactive object in an interactive object displayed in        the first virtual operation panel, the interactive device being        associated with the VR scenario; and    -   executing a target event corresponding to the target interactive        object in the VR scenario in response to the interactive        operation instruction.

The processor 171 is further configured to perform the following step:obtaining a touch operation instruction generated by a touch operationperformed by the interactive device on the target interactive object,where the interactive operation instruction includes the touch operationinstruction, and the touch operation instruction is used for triggeringthe target event corresponding to the target interactive object.

The processor 171 is further configured to perform the following step:obtaining first position information of the interactive device duringgenerating of the touch operation instruction, where the first positioninformation is used for indicating a first position of a virtual objectof the interactive device in the VR scenario on the first virtualoperation panel; and executing, in a case that the first positioninformation meets a preset condition, the target event corresponding tothe target interactive object triggered by the touch operationinstruction in the VR scenario.

The processor 171 is further configured to perform the following step:displaying first feedback information in the VR scenario after obtainingthe touch operation instruction generated by the touch operationperformed by the interactive device on the target interactive object,and/or outputting second feedback information to the interactive device,where the second feedback information is used for instructing theinteractive device to perform a target operation.

The processor 171 is further configured to perform the following steps:obtaining a first interactive operation instruction in a case that afirst gesture performed on the first target interactive object by avirtual object of the interactive device in the VR scenario is a firstpreset gesture, where the interactive operation instruction includes thefirst interactive operation instruction, the first interactive operationinstruction is used for triggering a target event of preparing formoving the first virtual operation panel, and the target interactiveobject includes the first target interactive object; obtaining a secondinteractive operation instruction after the first interactive operationinstruction is responded to, where the interactive operation instructionincludes the second interactive operation instruction, and the secondinteractive operation instruction is used for triggering a target eventthat the first virtual operation panel moves as the virtual objectmoves; and obtaining a third interactive operation instruction in a casethat the first gesture changes to a second gesture, and the secondgesture is a second preset gesture, where the interactive operationinstruction includes the third interactive operation instruction, andthe third interactive operation instruction is used for triggering thevirtual object to stop a target event of moving the first virtualoperation panel.

The processor 171 is further configured to perform the following steps:obtaining second position information of the interactive device duringgenerating the third interactive operation instruction, where the secondposition information is used for indicating a second position of thevirtual object of the interactive device in the VR scenario; determininga region including the second position in the VR scenario as a targetdisplay region of the first virtual operation panel; and displaying thefirst virtual operation panel in the target display region.

The processor 171 is further configured to perform the following step:during the obtaining the second interactive operation instructiongenerated by a second operation performed on the first virtual operationpanel, controlling the first virtual operation panel to be towards apreset direction in a moving process in the VR scenario.

The processor 171 is further configured to perform the following steps:before the interactive operation instruction is responded to, obtaininga second target operation instruction in the VR scenario; selecting anddisplaying at least one second virtual operation panel corresponding tothe second target operation instruction from the plurality of virtualoperation panels in the VR scenario; and obtaining an interactiveoperation instruction generated by an interactive operation performed bythe interactive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel and the at leastone second virtual operation panel.

The processor 171 is further configured to perform the following steps:obtaining a fourth interactive operation instruction generated by aninteractive operation performed by the interactive device on a thirdtarget interactive object displayed in the first virtual operationpanel, where the target interactive object includes the third targetinteractive object, the interactive operation instruction includes thefourth interactive operation instruction, and the fourth interactiveoperation instruction is used for triggering a target event of closingthe first virtual operation panel; and executing the target event ofclosing the first virtual operation panel triggered by the fourthinteractive operation instruction in the VR scenario in response to thefourth interactive operation instruction.

The processor 171 is further configured to perform the following steps:before selecting and displaying the first virtual operation panelcorresponding to the first target operation instruction from theplurality of virtual operation panels in the VR scenario, obtaining a 2Dinterface including the interactive object; and combining the 2Dinterface and a mesh model in the VR scenario, to obtain the firstvirtual operation panel, where the mesh model is used for marking aregion that is used for performing an interactive operation and that isin the VR scenario.

The processor 171 is further configured to perform the following step:obtaining, in a case that a collider of the first virtual operationpanel and a collider of the virtual object of the interactive device inthe VR scenario intersect, the interactive operation instructionperformed by the interactive device on the target interactive object inthe interactive object displayed in the first virtual operation panel.

By using this embodiment of this application, a solution of aninformation interaction method is provided. A first target operationinstruction is obtained in a VR scenario; a first virtual operationpanel corresponding to the first target operation instruction isselected and displayed from a plurality of virtual operation panels inthe VR scenario, the plurality of virtual operation panels beingdisplayed mutually independently, and being respectively configured todisplay different interactive objects; an interactive operationinstruction generated by an interactive operation performed by aninteractive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel is obtained, theinteractive device being associated with the VR scenario; and a targetevent corresponding to the target interactive object is executed in theVR scenario in response to the interactive operation instruction. Aplurality of mutually independent virtual operation panels in the VRscenario is respectively configured to display different interactiveinformation, to implement different functions, thereby achieving theobjective of operating the virtual operation panel, improving operationflexibility of the virtual operation panel, and further resolving thetechnical problem of low flexibility information interaction in therelated technology.

Optionally, for examples in this embodiment, reference may be made tothe examples described in the foregoing embodiments. Details are notdescribed in this embodiment.

A person of ordinary skill in the art may understand that, the structureshown in FIG. 17 is only schematic. The electronic apparatus may be anelectronic apparatus such as a smartphone (such as an Android mobilephone or an iOS mobile phone), a tablet computer, a palmtop computer, amobile Internet device (MID), or a PAD. FIG. 17 does not limit thestructure of the electronic apparatus. For example, the electronicapparatus may further include more or fewer components (such as anetwork interface and a display apparatus) than those shown in FIG. 17,or have a configuration different from that shown in FIG. 17.

A person of ordinary skill in the art may understand that all or some ofthe steps of the methods of the foregoing embodiments may be implementedby a program instructing relevant hardware of the electronic apparatus.The program may be stored in a computer readable storage medium. Thestorage medium may be a flash disk, a read-only memory (ROM), a randomaccess memory (RAM), a magnetic disk, or an optical disc.

An embodiment of this application further provides a storage medium.Optionally, in this embodiment, the storage medium stores a computerprogram. The computer program, when run, is configured to perform theinformation interaction method.

Optionally, in this embodiment, the storage medium may be located in atleast one of a plurality of network devices in the network shown in theforegoing embodiments.

Optionally, in this embodiment, the storage medium is configured tostore program code used for performing the following steps:

-   -   obtaining a first target operation instruction in a VR scenario;    -   selecting and displaying a first virtual operation panel        corresponding to the first target operation instruction from a        plurality of virtual operation panels in the VR scenario, the        plurality of virtual operation panels being displayed mutually        independently, and being respectively configured to display        different interactive objects;    -   obtaining an interactive operation instruction generated by an        interactive operation performed by an interactive device on a        target interactive object in an interactive object displayed in        the first virtual operation panel, the interactive device being        associated with the VR scenario; and    -   executing a target event corresponding to the target interactive        object in the VR scenario in response to the interactive        operation instruction.

Optionally, the storage medium is further configured to store programcode used for performing the following step: obtaining a touch operationinstruction generated by a touch operation performed by the interactivedevice on the target interactive object, where the interactive operationinstruction includes the touch operation instruction, and the touchoperation instruction is used for triggering the target eventcorresponding to the target interactive object.

Optionally, the storage medium is further configured to store programcode used for performing the following steps: obtaining first positioninformation of the interactive device during generating of the touchoperation instruction, where the first position information is used forindicating a first position of a virtual object of the interactivedevice in the VR scenario on the first virtual operation panel; andexecuting, in a case that the first position information meets a presetcondition, the target event corresponding to the target interactiveobject triggered by the touch operation instruction in the VR scenario.

Optionally, the storage medium is further configured to store programcode used for performing the following steps: displaying first feedbackinformation in the VR scenario after obtaining the touch operationinstruction generated by the touch operation performed by theinteractive device on the target interactive object, and/or outputtingsecond feedback information to the interactive device, where the secondfeedback information is used for instructing the interactive device toperform a target operation.

Optionally, the storage medium is further configured to store programcode used for performing the following steps: obtaining a firstinteractive operation instruction in a case that a first gestureperformed on a first target interactive object by a virtual object ofthe interactive device in the VR scenario is a first preset gesture,where the interactive operation instruction includes the firstinteractive operation instruction, the first interactive operationinstruction is used for triggering a target event of preparing formoving the first virtual operation panel, and the target interactiveobject includes the first target interactive object; obtaining a secondinteractive operation instruction after the first interactive operationinstruction is responded to, where the interactive operation instructionincludes the second interactive operation instruction, and the secondinteractive operation instruction is used for triggering a target eventthat the first virtual operation panel moves as the virtual objectmoves; and obtaining a third interactive operation instruction in a casethat the first gesture changes to a second gesture, and the secondgesture is a second preset gesture, where the interactive operationinstruction includes the third interactive operation instruction, andthe third interactive operation instruction is used for triggering thevirtual object to stop a target event of moving the first virtualoperation panel.

Optionally, the storage medium is further configured to store programcode used for performing the following steps: obtaining second positioninformation of the interactive device during generating of the thirdinteractive operation instruction, where the second position informationis used for indicating a second position of the virtual object of theinteractive device in the VR scenario; determining a region includingthe second position in the VR scenario as a target display region of thefirst virtual operation panel; and displaying the first virtualoperation panel in the target display region.

Optionally, the storage medium is further configured to store programcode used for performing the following step: when obtaining the secondinteractive operation instruction performed on a second operationperformed by the first virtual operation panel, controlling the firstvirtual operation panel to be towards a preset direction in a movingprocess in the VR scenario.

Optionally, the storage medium is further configured to store programcode used for performing the following steps: before the interactiveoperation instruction is responded to, obtaining a second targetoperation instruction in the VR scenario; selecting and displaying atleast one second virtual operation panel corresponding to the secondtarget operation instruction from the plurality of virtual operationpanels in the VR scenario; and obtaining an interactive operationinstruction generated by an interactive operation performed by theinteractive device on a target interactive object in an interactiveobject displayed in the first virtual operation panel and the at leastone second virtual operation panel.

Optionally, the storage medium is further configured to store programcode used for performing the following steps: obtaining a fourthinteractive operation instruction generated by an interactive operationperformed by the interactive device on a third target interactive objectdisplayed in the first virtual operation panel, where the targetinteractive object includes the third target interactive object, theinteractive operation instruction includes the fourth interactiveoperation instruction, and the fourth interactive operation instructionis used for triggering a target event of closing the first virtualoperation panel; and executing the target event of closing the firstvirtual operation panel triggered by the fourth interactive operationinstruction in the VR scenario in response to the fourth interactiveoperation instruction.

Optionally, the storage medium is further configured to store programcode used for performing the following steps: before selecting anddisplaying the first virtual operation panel corresponding to the firsttarget operation instruction from the plurality of virtual operationpanels in the VR scenario, obtaining a 2D interface including theinteractive object; and combining the 2D interface and a mesh model inthe VR scenario, to obtain the first virtual operation panel, where themesh model is used for marking a region that is used for performing aninteractive operation and that is in the VR scenario.

Optionally, the storage medium is further configured to store programcode used for performing the following step: obtaining, in a case that acollider of the first virtual operation panel and a collider of thevirtual object of the interactive device in the VR scenario intersect,the interactive operation instruction performed by the interactivedevice on the target interactive object in the interactive objectdisplayed in the first virtual operation panel.

Optionally, for examples in this embodiment, reference may be made tothe examples described in the foregoing embodiments. Details are notdescribed in this embodiment.

Optionally, in this embodiment, the storage medium may include, but isnot limited to: any medium that can store program code, such as a USBflash drive, a ROM, a RAM, a removable hard disk, a magnetic disk, or anoptical disc.

The sequence numbers of the foregoing embodiments of this applicationare merely for description purpose and do not indicate the preference ofthe embodiments.

If the integrated units in the foregoing embodiments are implemented ina form of software functional units and are sold or used as anindependent product, the units may be stored in a computer readablestorage medium. Based on such understanding, the technical solutions ofthis application essentially, or some contributing to the relatedtechnology, or all or some of the technical solutions may be implementedin a form of a software product. The computer software product is storedin a storage medium and includes several instructions for instructingone or more computer devices (which may be a personal computer, aserver, a network device, or the like) to perform all or some of stepsof the methods in the embodiments of this application.

In the foregoing embodiments of this application, descriptions of theembodiments have different emphases, and as for parts that are notdescribed in detail in one embodiment, reference can be made to therelevant descriptions of the other embodiments.

In the several embodiments provided in the present application, itshould be understood that the disclosed client may be implemented inother manners. The described apparatus embodiments are merely schematic.For example, division of the units is merely division of logicfunctions, and there may be another division manner during actualimplementation. For example, multiple units or components may becombined or may be integrated into another system, or some features maybe omitted or not be executed. In addition, the displayed or discussedmutual coupling, or direct coupling, or communication connections may beimplemented through some interfaces. Indirect coupling or communicationconnections between the units or modules may be implemented inelectronic or other forms.

The units described as separate parts may or may not be physicallyseparate, and the parts displayed as units may or may not be physicalunits, may be located in one position, or may be distributed on aplurality of network units. Some of or all of the units may be selectedaccording to actual needs to achieve the objectives of the solutions ofthe embodiments.

In addition, functional units in the embodiments of this application maybe integrated into one processing unit, or each of the units may existalone physically, or two or more units may be integrated into one unit.The integrated units may be implemented in a form of hardware or may beimplemented in a form of a software functional unit.

The above descriptions are merely optional implementations of thisapplication, and a person of ordinary skill in the art can make variousimprovements and refinements without departing from the spirit of thisapplication. All such modifications and refinements should also beintended to be covered by this application.

What is claimed is:
 1. An information interaction method, comprising:simultaneously and mutually independently displaying, within athree-dimensional (3D) virtual reality (VR) generated environment, aplurality of virtual operation panels, each of the virtual operationpanels associated with a respective one of a plurality of functions, andeach of the virtual operation panels displaying an associated one of aplurality of sets of interactive objects, each of the virtual operationpanels independently selectable by a virtual object of an interactivedevice controlled by a user of the 3D VR generated environment, each ofthe interactive objects of each of sets of interactive objectsindependently selectable by the virtual object, and each of theplurality of virtual operation panels comprises a respective one of aplurality of close buttons; obtaining, by a processing circuitry, afirst target operation instruction from the interactive device; inresponse to the first target operation instruction, selecting, by thevirtual object within the 3D VR generated environment, a first virtualoperation panel from among the simultaneously displayed plurality ofvirtual operation panels, the first virtual operation panel displaying afirst set of interactive objects of the plurality of sets of interactiveobjects; obtaining, by the processing circuitry, a grasp operationinstruction from the interactive device for a virtual hand to grasp oneof the plurality operation panels and a move instruction to move thevirtual hand after grasping the one of the plurality of operationpanels; in response to the grasp operation instruction and the moveinstruction, moving the plurality of operation panels in the 3D VRgenerated environment such that the plurality of operation panels alwaysfaces a head position of the user; obtaining, by the processingcircuitry, an interactive operation instruction from the interactivedevice; in response to the interactive operation instruction, selectinga target interactive object from among the first set of interactiveobjects displayed in the first virtual operation panel and applying aninteractive operation on the target interactive object with the virtualobject of the interactive device while the plurality of virtualoperation panels and the plurality of sets of interactive objects aresimultaneously displayed in the 3D VR generated environment; executing,by the processing circuitry, a target event corresponding to the targetinteractive object in the 3D VR generated environment in response toapplying the interactive operation on the target interactive object withthe virtual object of the interactive device; clicking, by the virtualobject in the 3D VR generated environment, a close button of theplurality of close buttons, the close button associated with the firstvirtual operation panel; and in response to clicking the close button,destroying, by the processing circuitry, the first virtual operationpanel in the 3D VR generated environment without destroying any othervirtual operation panel of the plurality of virtual operation panelsbeing displayed in the 3D VR generated environment.
 2. The methodaccording to claim 1, wherein the obtaining an interactive operationinstruction from the interactive device comprises: obtaining, by theprocessing circuitry, a touch operation instruction generated by a touchoperation performed by the interactive device on the target interactiveobject, wherein the interactive operation instruction comprises thetouch operation instruction, and the touch operation instruction isconfigured to trigger execution of the target event corresponding to thetarget interactive object.
 3. The method according to claim 2, whereinthe executing a target event corresponding to the target interactiveobject in the (3D) VR generated environment in response to theinteractive operation instruction comprises: obtaining, by theprocessing circuitry, first position information of the interactivedevice during generation of the touch operation instruction, wherein thefirst position information is used for indicating a first position ofthe virtual object of the interactive device in the (3D) VR generatedenvironment on the first virtual operation panel; and when the firstposition information meets a preset condition, executing, by theprocessing circuitry, the target event that corresponds to the targetinteractive object and that is triggered by the touch operationinstruction in the (3D) VR generated environment.
 4. The methodaccording to claim 2, wherein after the obtaining a touch operationinstruction generated by a touch operation performed by the interactivedevice on the target interactive object, the method further comprises:displaying, by the processing circuitry, first feedback information inthe (3D) VR generated environment; and/or outputting, by the processingcircuitry, second feedback information to the interactive device,wherein the second feedback information is used for instructing theinteractive device to perform a target operation.
 5. The methodaccording to claim 1, wherein the obtaining an interactive operationinstruction from the interactive device comprises: obtaining, by theprocessing circuitry, a first interactive operation instruction when afirst gesture performed on a first target interactive object by thevirtual object of the interactive device in the (3D) VR generatedenvironment is a first preset gesture, wherein the interactive operationinstruction comprises the first interactive operation instruction, thefirst interactive operation instruction is configured to triggerexecution of a target event of preparing for moving the first virtualoperation panel, and the target interactive object comprises the firsttarget interactive object; obtaining, by the processing circuitry, asecond interactive operation instruction after the first interactiveoperation instruction is responded to, wherein the interactive operationinstruction comprises the second interactive operation instruction, andthe second interactive operation instruction is configured to triggerexecution of a target event that the first virtual operation panel movesas the virtual object moves; and obtaining, by the processing circuitry,a third interactive operation instruction when the first gesture changesto a second gesture, and the second gesture is a second preset gesture,wherein the interactive operation instruction comprises the thirdinteractive operation instruction, and the third interactive operationinstruction is configured to initiate execution of the virtual object tostop a target event of moving the first virtual operation panel.
 6. Themethod according to claim 5, wherein the executing a target eventcorresponding to the target interactive object in the (3D) VR generatedenvironment in response to the interactive operation instructioncomprises: obtaining, by the processing circuitry, second positioninformation of the interactive device during generating of the thirdinteractive operation instruction, wherein the second positioninformation is configured to indicate a second position of the virtualobject of the interactive device in the (3D) VR generated environment;determining, by the processing circuitry, a region comprising the secondposition in the (3D) VR generated environment as a target display regionof the first virtual operation panel; and displaying, by the processingcircuitry, the first virtual operation panel in the target displayregion, wherein the target event comprises the event of displaying thefirst virtual operation panel in the target display region.
 7. Themethod according to claim 5, wherein during the obtaining the secondinteractive operation instruction performed on the first virtualoperation panel, the method further comprises: controlling, by theprocessing circuitry, the first virtual operation panel to be movedtowards a preset direction in a moving process in the (3D) VR generatedenvironment.
 8. The method according to claim 1, wherein before theinteractive operation instruction is responded to, the method furthercomprises: obtaining, by the processing circuitry, a second targetoperation instruction in the (3D) VR generated environment; selectingand displaying, within the (3D) VR generated environment, at least onesecond virtual operation panel corresponding to the second targetoperation instruction from the plurality of virtual operation panels inthe (3D) VR generated environment; and obtaining, by the processingcircuitry, an interactive operation instruction generated by aninteractive operation applied on a target interactive object in aninteractive object displayed in the first virtual operation panel andthe at least one second virtual operation panel, wherein the interactiveoperation is performed by the interactive device.
 9. The methodaccording to claim 1, wherein: the obtaining an interactive operationinstruction from the interactive device comprises: obtaining a fourthinteractive operation instruction generated by an interactive operationperformed by the interactive device on a third target interactive objectdisplayed in the first virtual operation panel, wherein the targetinteractive object comprises the third target interactive object, theinteractive operation instruction comprises the fourth interactiveoperation instruction, and the fourth interactive operation instructionis configured to trigger execution of a target event of closing thefirst virtual operation panel; and the executing a target eventcorresponding to the target interactive object in the (3D) VR generatedenvironment in response to the interactive operation instructioncomprises: executing the target event of closing the first virtualoperation panel triggered by the fourth interactive operationinstruction in the (3D) VR generated environment in response to thefourth interactive operation instruction.
 10. The method according toclaim 1, wherein before the selecting a first virtual operation panelfrom among the simultaneously displayed plurality of virtual operationpanels in the (3D) VR generated environment, the method furthercomprises: obtaining, by the processing circuitry, a two-dimensional(2D) interface comprising the target interactive object; and combining,by the processing circuitry, the 2D interface and a mesh model in the(3D) VR generated environment, to obtain the first virtual operationpanel, wherein the mesh model is used for marking a region that is usedfor performing an interactive operation and that is in the (3D) VRgenerated environment.
 11. The method according to claim 1, wherein theobtaining an interactive operation instruction from the interactivedevice comprises: obtaining, when a collider of the first virtualoperation panel and a collider of the virtual object of the interactivedevice in the (3D) VR generated environment intersect, the interactiveoperation instruction from the interactive device.
 12. The methodaccording to claim 1, wherein a size of each of the plurality of virtualoperation panels is determined by an associated one of a plurality oftarget interactive objects each displayed on a respective one of aplurality of virtual operation panels.
 13. An information interactionapparatus, comprising one or more processors and one or more memoriesstoring executable program units, the program units configured to beexecuted by the processor to: simultaneously and mutually independentlydisplay, within a three-dimensional (3D) virtual reality (VR) generatedenvironment, a plurality of virtual operation panels, each of thevirtual operation panels associated with a respective one of a pluralityof functions, and each of the virtual operation panels displaying anassociated one of a plurality of sets of interactive objects, each ofthe virtual operation panels independently selectable by a virtualobject of an interactive device controlled by a user of the (3D) VRgenerated environment, and each of the interactive objects of each ofsets of interactive objects independently selectable by the virtualobject, and each of the plurality of virtual operation panels comprisesa respective one of a plurality of close buttons; obtain a first targetoperation instruction from the interactive device; in response to thefirst target operation instruction, select, by the virtual object withinthe (3D) VR generated environment, a first virtual operation panel fromamong the simultaneously displayed plurality of virtual operationpanels, the first virtual operation panel displaying a first set ofinteractive objects of the plurality of sets of interactive objects;obtain a grasp operation instruction from the interactive device for avirtual hand to grasp one of the plurality operation panels and a moveinstruction to move the virtual hand after grasping the one of theplurality of operation panels; in response to the grasp operationinstruction and the move instruction, move the plurality of operationpanels in the 3D VR generated environment such that the plurality ofoperation panels always faces a head position of the user; obtain aninteractive operation instruction from the interactive device; inresponse to the interactive operation instruction, select a targetinteractive object from among the first set of interactive objectsdisplayed in the first virtual operation panel and apply an interactiveoperation on the target interactive object with the virtual object ofthe interactive device while the plurality of virtual operation panelsand the plurality of sets of interactive objects are simultaneouslydisplayed in the (3D) VR generated environment; execute a target eventcorresponding to the target interactive object in the (3D) VR generatedenvironment in response to application of the interactive operation onthe target interactive object with the virtual object of the interactivedevice; click, with the virtual object in the (3D) VR generatedenvironment, a close button of the plurality of close buttons, the closebutton associated with the first virtual operation panel; and inresponse to clicking the close button, destroy the first virtualoperation panel in the (3D) VR generated environment without destroyingany other virtual operation panel of the plurality of virtual operationpanels being displayed in the (3D) VR generated environment.
 14. Theinformation interaction apparatus according to claim 13, wherein theprogram units are configured to be executed by the processor to: obtainthe interactive operation instruction by obtaining a touch operationinstruction generated by a touch operation performed by the interactivedevice on the target interactive object, wherein the interactiveoperation instruction comprises the touch operation instruction, and thetouch operation instruction is configured to trigger execution of thetarget event corresponding to the target interactive object.
 15. Theinformation interaction apparatus according to claim 14, wherein theprogram units are configured to be executed by the processor to executethe target event corresponding to the target interactive object in the(3D) VR generated environment in response to the interactive operationinstruction by: obtaining first position information of the interactivedevice during generation of the touch operation instruction, wherein thefirst position information is used for indicating a first position ofthe virtual object of the interactive device in the (3D) VR generatedenvironment on the first virtual operation panel; and when the firstposition information meets a preset condition, execute the target eventthat corresponds to the target interactive object and that is triggeredby the touch operation instruction in the (3D) VR generated environment.16. The information interaction apparatus according to claim 13, whereinthe program units are further configured to, before the selection of afirst virtual operation panel from among the simultaneously displayedplurality of virtual operation panels in the (3D) VR generatedenvironment: obtain a two-dimensional (2D) interface comprising theinteractive object; and combine the 2D interface and a mesh model in the(3D) VR generated environment, to obtain the first virtual operationpanel, wherein the mesh model is used for marking a region that is usedfor performing an interactive operation and that is in the (3D) VRgenerated environment.
 17. A non-transitory storage unit storingexecutable instructions that, when executed by processing circuitry, areconfigured to cause the processing circuitry to: simultaneously andmutually independently display, within a three-dimensional (3D) virtualreality (VR) generated environment, a plurality of virtual operationpanels, each of the virtual operation panels associated with arespective one of a plurality of functions, and each of the virtualoperation panels displaying an associated one of a plurality of sets ofinteractive objects, each of the virtual operation panels independentlyselectable by a virtual object of an interactive device controlled by auser of the (3D) VR generated environment, and each of the interactiveobjects of each of sets of interactive objects independently selectableby the virtual object; obtain a first target operation instruction fromthe interactive device; in response to the first target operationinstruction, select, by the first object within the (3D) VR generatedenvironment, a first virtual operation panel from among thesimultaneously displayed plurality of virtual operation panels, thefirst virtual operation panel configured to display a first set ofinteractive objects of the plurality of sets of interactive objects;obtain a grasp operation instruction from the interactive device for avirtual hand to grasp one of the plurality operation panels and a moveinstruction to move the virtual hand after grasping the one of theplurality of operation panels; in response to the grasp operationinstruction and the move instruction, move the plurality of operationpanels in the 3D VR generated environment such that the plurality ofoperation panels always faces a head position of the user; obtain aninteractive operation instruction from the interactive device; inresponse to the interactive operation instruction, select a targetinteractive object from among the first set of interactive objectsdisplayed in the first virtual operation panel and apply an interactiveoperation on the target interactive object with the virtual object ofthe interactive device while the plurality of virtual operation panelsand the plurality of sets of interactive objects are simultaneouslydisplayed in the (3D) VR generated environment; execute a target eventcorresponding to the target interactive object in the (3D) VR generatedenvironment in response to application of the interactive operation onthe target interactive object with the virtual object of the interactivedevice; click, with the virtual object in the (3D) VR generatedenvironment, a close button of the plurality of close buttons, the closebutton associated with the first virtual operation panel; and inresponse to clicking the close button, destroy the first virtualoperation panel in the (3D) VR generated environment without destroyingany other virtual operation panel of the plurality of virtual operationpanels being displayed in the (3D) VR generated environment.
 18. Thenon-transitory storage unit according to claim 17, wherein theinstructions, when executed by processing circuitry, are configured tocause the processing circuitry to: obtain the interactive operationinstruction by obtaining a touch operation instruction generated by atouch operation performed by the interactive device on the targetinteractive object, wherein the interactive operation instructioncomprises the touch operation instruction, and the touch operationinstruction is configured to trigger execution of the target eventcorresponding to the target interactive object.
 19. The non-transitorystorage unit according to claim 18, wherein the instructions, whenexecuted by processing circuitry, are configured to cause the processingcircuitry to execute the target event corresponding to the targetinteractive object in the (3D) VR generated environment in response tothe interactive operation instruction by: obtaining first positioninformation of the interactive device during generation of the touchoperation instruction, wherein the first position information is usedfor indicating a first position of the virtual object of the interactivedevice in the (3D) VR generated environment on the first virtualoperation panel; and when the first position information meets a presetcondition, execute the target event that corresponds to the targetinteractive object and that is triggered by the touch operationinstruction in the (3D) VR generated environment.
 20. The non-transitorystorage unit according to claim 17, wherein the instructions, whenexecuted by processing circuitry, are configured to further cause theprocessing circuitry to, before causing the processing circuitry toselect a first virtual operation panel from among the plurality ofvirtual operation panels in the (3D) VR generated environment: obtain atwo-dimensional (2D) interface comprising the interactive object; andcombine the 2D interface and a mesh model in the (3D) VR generatedenvironment, to obtain the first virtual operation panel, wherein themesh model is used for marking a region that is used for performing aninteractive operation and that is in the (3D) VR generated environment.